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1 Complexity Theory 


Recall that a (simple, undirected) graph G is a set of vertices V along with a set of 
edges E’, where each edge e € E is a two-element subset of V. For the purpose of 
this question, all graphs are simple, undirected graphs. 


For a graph G = (V,£) and an edge e € E, we write G — e to denote the graph 
obtained from G by removing the edge e. That is G—e has exactly the same vertices 
as G and all edges in F except for e. 


What is a Hamiltonian cycle in a graph G = (V, E)? [2 marks] 


What is known about the complexity of deciding whether a given graph G has 
a Hamiltonian cycle? [2 marks] 


Show that G has a Hamiltonian cycle that does not include the edge e if, and 
only if, G — e has a Hamiltonian cycle. [4 marks] 


Assume that P=NP. Using this assumption, show that there is a polynomial-time 
algorithm A such that if A is given a graph G = (V,£), it will return “no” if 
G does not contain a Hamiltonian cycle and return a Hamiltonian cycle of G 
otherwise. [12 marks] 
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2 Complexity Theory 


Let f : 4* > &* be a function on %-strings for some finite alphabet ©. Say that f is 
a pseudo one-way function if it satisfies the following three conditions: 


e There is a constant k such that for every x € Ut, |x|'/* < |f(x)| < |x|". (Here 
|x| denotes the length of a string x). 


e f is computable by a polynomial-time algorithm. 


e There is no function g, computable in polynomial time, such that f(g(y)) = y 
for all strings y in the range (i.e. image) of f. 


For a pseudo one-way function f, let Ly C &* x &* be the following set 


Lp =41(@9) | 324 Sigs ond f(z) =}. 


Here <j-x denotes the lexicographic order on strings. 


(a) How would you modify the definition of a pseudo one-way function to obtain 
the definition of a one-way function in the sense defined by Papadimitriou? 
[3 marks] 


(b) Show that for any pseudo one-way function f, the language Ly is in NP. 
[4 marks] 


(c) Show that for any pseudo one-way function f, the language Ly is not in P. 
[4 marks] 


In the following, @ denotes an arbitrary Boolean formula and Ta list assigning a 
Boolean value to each variable appearing in ¢. Fix © to be a suitable alphabet in 
which we can write @ and T' as well as the string “no” and consider the following 
function defined on all /-strings. 


(a) = { p if x = (@,T) and T satisfies @ 


‘no”’x otherwise 


(d) Prove that if PANP, then s is a pseudo one-way function. [9 marks] 
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3 Computation Theory 


(a) Define what is meant by a configuration and a computation of a register machine 
(RM). Explain carefully what it means to say that a computation halts. 
[5 marks] 


(b) Define the notion of RM computable partial numerical function of n arguments. 
[2 marks] 


(c) What does it mean for a problem (expressed as a property of numbers) to be 
RM undecidable? [2 marks] 


(d) A computation of a RM is said to be circular if it reaches the same configuration 
at two different times. 


(¢) Explain why a circular computation does not halt. Give an example of a 
RM computation that does not halt, but that is not circular. [2 marks] 


(ii) The Circularity Problem is: Decide whether or not the computation of any 
given RM and initial register contents is circular. Give a proof that the 
Circularity Problem is undecidable. You may assume suitable functions for 
encoding and decoding pairs of numbers as numbers, finite lists of numbers 
as numbers, and RM programs as numbers. [9 marks] 
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4 Computation Theory 


(a) 


For the A-calculus, define the notions of 

(i) @B-conversion (=g) [2 marks] 
(it) Church numeral (n) [2 marks] 
What does it mean for a total function f : N° > N to be A-definable? Explain 
why it is the case that not every f : N” > N is \-definable, carefully stating any 


standard results that you rely upon. [3 marks] 


Explain why the predecessor function pred : N > N 


0 PeRs0 
d =——- 
pea) a fes-0 


is \-definable and give a A-term that represents it. [4 marks] 


Show that the following functions are \-definable. For each part you may assume 
solutions to the previous parts of the question. 


itv 0 
(i) ifg: N7 ON, where éfo(z, y,z) = # - [3 marks] 
a abe 0 
0 if*=Oandy=0 
(ii) and: N? +N, where and(z,y) = : a WeMie [1 mark] 
1 tte Oor gy 0 
bs , x—-y ifx>y 
(ii7) monus : N* + N, where monus(z, y) = [3 marks] 
0 i ee Scy 
7 0 taeHy 
(iv) eq: N* +N, where eq(z,y) = [2 marks] 
aE Sey 
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These three plots are adapted from xkcd comic 2048 “Curve-fitting methods and the 
messages they send” by Randall Munroe (CC BY-NC 2.5)". 


(a) Describe a probability model and a fitting procedure that might be behind the 
“Quadratic” plot. Give pseudocode for the fitting procedure. Explain briefly 
how the plot is produced. [Note: When describing your model, remember to 
state any relevant probability distributions. | 


(b) Repeat part (a) for the “Piecewise” plot. 


[7 marks] 


[5 marks] 


(c) Repeat part (a) for the “Confidence interval” plot. In your answer, explain 


carefully the basis for your confidence interval calculation. 


[8 marks] 


' https: //creativecommons.org/licenses/by-nc/2.5/legalcode 
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6 Data Science 


Here are two binary sequences: 


x = 111010100100001011110011 
y = 000000011111111111110000 


(a) Consider a model in which each element of x is an independent Bernoulli random 


variable, Bin(1,p). Estimate p, and give a formula for the log likelihood of the 
x sequence. Repeat for y. Explain why the log likelihoods are the same for the 
two sequences. [4 marks] 


The model from part (a) might seem a poor choice for y. Explain how to conduct 
a hypothesis test to determine whether this is so. In your answer you should 
define the test statistic you have invented for the test, and you should explain 
your choice of one-sided or two-sided testing. [8 marks] 


Consider an alternative model, in which y is generated from a two-state Markov 
chain, with the first item of y drawn from the chain’s stationary distribution. 
Give a formula for the log likelihood of y, and explain how to fit the model. 

[8 marks] 


[Note: You do not need to find numerical answers. You may be interested to know 
that for the independent model the log likelihoods are both —16.55, and for the 
Markov model the log likelihood of w is —16.47 and that for y is —9.00.] 
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7 Logic and Proof 
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(a) Exhibit a model for the following set of formulas, or prove that none exists. 
Briefly explain your work in each step. 


te 


P—>(R->Q) No Ga a can Q>S AAT SoQVT 


[6 marks] 


(b) For each of the following sets of formulas, either exhibit an interpretation in $4 
modal logic that satisfies them simultaneously at a particular world, w, or show 
through a formal proof that they cannot be satisfied. 


ES Qs 


(i) © 


(wi) OPV Q), 


8 Logic and 


Proof 


CEQ, CP - ORN ©uAR), ( AQ V 30P) 


[8 marks] 


OnP, AQ 


[6 marks] 


Which of the following formulas is valid? Prove them using resolution or find a 
counterexample. If a counterexample exists, explain how resolution is blocked from 
producing a spurious proof. 


(a) (Ve [-Q(e,2) + P(2))) + Ve [P(2) v 2y Q(2,y9)] (7 marks] 


(b) [Ax P(x)| - ax P(f(z)) [6 marks] 


(c) AzVw [(Vz[P(2) > 


y Qa, y)]) + (Pw) > Q(w, z))] [7 marks] 
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9 Semantics of Programming Languages 


The relational algebra is a small language for manipulating sets of tuples, and is one 
of the central objects of study in database theory. We can give a syntax for (a subset 
of) it as follows: 


4 


3oby Qu 


TW 


(a) 


= int | bool Data types 
Ss - 77 (| 8 Data values 
ae (cere ea Record types (with disjoint field names 1;) 
n= [kl =v1,...,ln =Un| Record values (with disjoint field names 1;) 
= Set.R Set types 
ah AT irowa tay Set literal 
|: elke’ Set union 
[> Bee Cartesian product with disjoint field labels 
| Tliysoct, (e) Records of e with fields not in 1,,...,l/, removed 
|  on=1,(e) Subset of e where the fields J; and Jy are equal 


State the form of the typing judgements for this language, and give typing 
rules for this programming language ascribing to each category of terms its 
corresponding types. [8 marks] 


Define a deterministic small-step operational semantics for this language, 
defining any auxiliary functions you need as well. [10 marks} 


Give a precise statement of the progress and preservation properties for this 
language. You do not need to give a proof. [2 marks] 
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10 Semantics of Programming Languages 


Consider the language with functions, integers, and printing. 


n= unit | int | 737’ Types 
e := « | rA4x:7.e | ee’ | skip | n | print(e) | e;e’ Terms 
The typing rule for print(e) is: 


Pies int 
TF print(e) : unit 


(a) Define a small-step, call-by-value operational semantics for this language. 
Clearly explain what the components of the machine configuration are, and 
how it identifies what is printed. [10 marks} 


(b) State a progress theorem for this language, and explain what it says about the 
evolution of the machine state. [4 marks] 


(c) Prove progress for the print(e) case, giving the names of any of the standard 
properties (such as substitution) that you needed to use in the proof. 
[6 marks] 


END OF PAPER 
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